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Abstract. In this paper we prove that there exists a smooth classical solution to the HJB 
j>^' equation for a large class of constrained problems with utility functions that are not neces- 

sarily differentiable or strictly concave. The value function is smooth if admissible controls 
satisfy an integrability condition or if it is continuous on the closure of its domain. The key 
idea is to work on the dual control problem and the dual HJB equation. We construct a 
smooth, strictly convex solution to the dual HJB equation and show that its conjugate func- 
tion is a smooth, strictly concave solution to the primal HJB equation satisfying the terminal 
Qn I and boundary conditions. 
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1 Introduction 
> 

ly-v | There has been extensive research in utility maximization. Two main methods are stochastic 

Q\ • control and convex duality. The stochastic control approach requires the underlying state 

process be Markovian and applies the dynamic programming principle and Ito's lemma to 
derive a nonlinear parabolic PDE (HJB equation) for the optimal value function. If there 
is a classical solution to the HJB equation one may then apply the verification theorem to 
show that the value function is smooth and find the optimal control as a byproduct. The 
convex duality approach requires the objective functional be concave and the state process be 
linear. It first solves a static maximization problem and applies convex analysis to show the 
existence of the optimal solutions to the primal and dual problems and establishes their dual 
relationship. It then uses the martingale representation theorem or more general optional 
decomposition theorem to super-replicate the optimal terminal wealth/consumption. For 
excellent expositions of these two methods in utility maximization, see [6l [91 \TU[ [T2] and 
references therein. 

The smoothness of the value function is a highly desirable property. One normally has 
to impose some conditions to ensure that. One key condition is the uniform ellipticity of 
the diffusion coefficient, which is not satisfied for the standard wealth process as long as 
doing nothing is a feasible portfolio trading strategy. When the trading constraint set is a 
closed convex cone and the utility function is strictly concave and continuously differentiable 
and satisfies some growth conditions and the market is complete the value function is a 
smooth solution to the HJB equation, see [Sj. When the constraint set is the whole space 
and the utility function is of power or logarithmic type, the value function has a closed-form 
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expression. The approach in [9J crucially depends on the differentiability and strict concavity 
of the utility function as the inverse function of the marginal utility is extensively used. 

For general non-smooth and/or non-strictly-concave utility functions it is not clear if there 
exist smooth solutions to the HJB equation. To deal with the lack of a priori knowledge of the 
differentiability of the value function one may use a weak solution concept and characterize 
the value function as a unique viscosity solution to the HJB equation. Due to the remarkable 
stability property of the viscosity solution one may solve the HJB equation numerically. It is 
in general difficult to show the differentiability of the value function even it is known to be a 
viscosity solution to the HJB equation (but see the remarkable paper [14J). The lack of the 
differentiability of the value function makes impossible to apply the verification theorem to 
find the optimal control. 

Consider a financial market consisting of one bank account and n stocks. The discounted 
price process S = (S 1 , . . . , S n )' of re risky assets is modelled by 

dS t = diag(S t )(b(t)dt + a(t)dW t ), 0<t<T 

with the initial price So = s, where diag(St) is a diagonal nxn matrix with diagonal elements 
SI, b and a are deterministic continuous vector and nonsingular matrix valued functions of 
time t, representing the stock excess returns and volatilities, respectively, and W is a re- 
dimensional standard Brownian motion on a complete probability space (Q,,J-,P), endowed 
with a natural filtration {J~t} generated by W. The discounted wealth process X satisfies 
the SDE 

dX t = X t {ir' t b(t)dt + n' t a(t)dW t ), X = x (1) 

where nt = (nj , . . . , n™)' are progressively measurable control processes satisfying m € K, a 
closed convex cone, a.s. for t £ [0, T]. 

A standard utility maximization problem is given by 

sup E[U(X T )] subject to (pQ) (2) 

where U is a utility function which is continuous, increasing, concave, and U(0) = 0. 

Denote by V(t, x) the value function of ([2]) for < t <T and x > 0. The corresponding 
HJB equation is given by 

-V t - H(t,x,V x (t,x),V xx (t,x)) = 0, x>0,t<T (3) 

with the terminal condition V(T,x) = U{x) and the boundary condition V(t, 0) = 0, where 
H is a Hamiltonian, defined by 

H(t,x,p,M) = sup {vr' b(t)xp + -\a(tyTr\ 2 x 2 M} (4) 

and Vt is a partial derivative of V with respect to t, V x and V xx are defined similarly. 

The contribution of this paper is that we show that there exists a smooth classical solution 
to the HJB equation ([3]) for a large class of constrained problems with utility functions that are 
not necessarily differentiable or strictly concave (Theorem l3.8p . The value function is smooth 
if admissible controls satisfy an integrability condition (Theorem 14. lj) or if it is continuous on 
the closure of its domain (Theorem [53]). The key idea is to work on the dual control problem 
and the dual HJB equation. We show that there is a smooth, strictly convex solution to 
the dual HJB equation and its conjugate function is a smooth, strictly concave solution 
to the primal HJB equation satisfying the terminal and boundary conditions. We use an 
observation which asserts that under certain structure conditions the solution of parabolic 
partial differential equations is smooth and strictly convex even if the initial date is not 
differentiable or strictly convex. This is related to the convexity preserving and constant 
rank principle for solution of partial differential equations, see [H El [HI [11] 



The rest of the paper is organized as follows. Section 2 reviews the existence results 
of nonsmooth utility maximization and characterizes the dual control problem. Section 3 
constructs the smooth solutions to the primal and dual HJB equations. Section 4 proves the 
verification theorem under an integrability condition for admissible controls. Section 5 shows 
that the primal and dual value functions are smooth if they are continuous on the closure of 
the domains with a comparison method. Section 6 gives two applications, one in the efficient 
frontier of utility and conditional value-at-risk, and the other in the monotonicity of absolute 
risk aversion measures. 

2 Dual Control Problem 

In this section we briefly review the main results on the existence of the optimal solutions to 
the primal and dual problems and characterize the dual control problem. We focus on the 
dual domain for the application of stochastic control theory. Almost all work in literature on 
utility maximization are for continuously differentiable and strictly concave utility functions. 
The main references for nonsmooth utility maximization are [U [5J [TBI HPT] . 

To use the duality method to study the value function of the utility maximization problem 
([2]) we need first to formulate a dual minimization problem with a well defined dual domain. 
The choice of the dual domain is often problem specific. For a complete market generated 
by Brownian motions [9] chooses dual variables as 

H t ,u = exp (- j d' S)U dW s - i J \9 s ,u\ 2 ds - J £(v s )ds) 

where Bt,v = a t Qh + u t), C( v ) = su 'PpeK(~ p' v ) is the support function of —if, and v are 
Ft progressively measurable processes satisfying E[f Q £(vt)dt] < oo. This gives a natural set 
of dual variables. The approach in [9] crucially depends on the assumption that the utility 
function U is differentiable and strictly concave and some other conditions. Results of [S] 
cannot be directly applied to the problem of this paper. On the other hand [9] provides an 
explicit construction of the dual process which turns out to be very useful in proving the dual 
relation of the primal and dual value functions. 

For general semimartingale asset price processes the duality method is normally used to 
show the existence of the optimal solutions to the primal and dual problems and to establish 
their dual relation. There are several definitions of dual variables depending on the primal 
problem formulation. [10] chooses the set of dual variables consisting of nonnegative super- 
martingale processes Y with Yq = y such that XY are supermartingales for all admissible 
wealth processes X with initial endowment x, while [1] takes nonnegative random variables 
Y in L 1 such that ^[XyY] < xy for all admissible terminal wealth Xt- 

Consider a security market consisting of d + 1 assets, one bond and d stocks. Assume 
bond price S° equals one and (discounted) stock price S = (S l )i<i<d is modeled by a (0, oo) d 
valued semimartingale on a filtered probability space (Q, T, (J r i)o<t<r>P)- Let K be a closed 
convex cone. Denote by O the set of admissible trading strategies such that every 8 6 is a 
predictable process, integrable with respect to S and valued in K a.s. for all t. 

The wealth process is defined by initial capital x and admissible strategy 9 as follows 

X%' = x + / 6 u dS u . 
Jo 

The set of nonnegative wealth processes with initial value x is defined by 

X+(x) := {X x ' e : 6 € and X x / > for all t G [0, T]} (5) 



and the set of terminal values of nonnegative wealth processes is defined by X+(x) := {X™ '■ 

X x,e G X+(x)}. The problem of maximizing the expected utility of the terminal wealth is 

given by 

V(x) = sup E[U(X)} 
Xex7(x) 

where U is an increasing concave utility function defined on the positive real line. The dual 
problem is formulated as 

V(y):= inf E[U(Y)] 

where U is the dual function of U, defined by 

U(y) := sup{U(x) — xy} 
x>0 

and yj.(y) is the set of dual variables, defined by 

yT( y ) ■= {Y G L° + : E[XY] < xy for all x G R + and X G Af+(a?)}. 

We now state the main theorem on the existence and the dual relation of the primal and 
dual problems. 

Theorem 2.1 Assume some technical conditions are satisfied (see ^j, Theorem, 3.2). Then 

1. There exist y > and Y G 3>+(j/) such that V(y) = E[U(Y)] and W{x) = V(y) + xy, 
where W(x) := inf y> o(V(y) + xy). 

2. There exists X G ATj(ar) such that V(x) = E[U(X)}. 

3. V(x) = W(x), E[XY] = xy, and X G -dU(Y). 

Remark 2.2 The technical conditions are related to the no- arbitrage of a financial market, 
the existence of a constrained optional decomposition, and the asymptotic elasticity of utility 
functions, see [3], Theorem 3.2 and [E], Theorem 5.1, for details. 

Proposition 2.3 Assume the same technical conditions and that U is strictly increasing. If 
Y is an optimal dual solution ofW{x), then Y > a.s. 

Proof. We first show that if Y(u) = 0, for some u £ Q, the optimal X{uj) = oo. From 
|16j . Theorem 5.1, rj = X{uS) G —dU(Y{uj)) = —dU(0). U is a convex function, then 
U(z) > U(0) - 7](z - 0), Vz > 0. U(z) > U{oo) - nz. U(z) = sup x>0 {U(x) - xz) = U{x) - xz 
if and only if z G dU(x). Assume rj < oo, choose any x > rj, then choose z G dU(x), z > 0. 
We have U(z) = U{x) -xz > U(0) — nz, which implies > U(x) — U(oo) > z{x — rj) > 0. 
This is a contradiction. We can now show that Y > a.s. Assume 3A C O, ¥(A) > 0, 
Y(oj) = 0,w G A, then X(oo) = oo,oj G A from the discussion above. For any equivalent 
probability measure Q, we have Eq[X] = Eq[X1a] + Bg[ilA c ] = oo, a contradiction to the 
budget constraint and the no-arbitrage condition. □ 

The dual domain 3^+(y) is a set of random variables. To formulate a dual control, we 
need to have the dual domain consisting of stochastic processes, not just random variables. 
It is suggested in [10] that a natural dual process domain is 

y+{y) = {Y > : Yq = y and XY is a supermartingale, for all X G X + (x)}. (6) 

This indeed serves our purpose. We have the following equivalent results of Theorem 12.11 

Theorem 2.4 Assume the same technical conditions are satisfied. Then 



1. There exist y* > and Y* G y+{y*) such that V(y*) = E[U(Yf)] and W(x) = V(y*) + 
xy* , where W(x) := m£ y> o(V(y) +xy). 

2. There exists X* G X+(x) such that V(x) = E[U(X T )]. 

3. V(x) = W{x), E[X T Y*} = xy*, and X T G -dU(Y*). 

Proof. Define 

V(y)= inf E[U(Xt)]. 

It is obvious that if Y G y+(y) then Yp G yT(y) and we have V(y) < V"(y). From Theorem 
0(1), there exist y > and Y G 3^+(y) such that W(x) = E[U(Y) + xy}. Since E[XY] < xy 
for all x > and X G Af_F(x) we have 

Y G {/i G L^(0,^,P) : < /i < Y T , for some F G y+(y)} 

by [TU], Proposition 3.1 (ii). Let y* = y. We can find &Y* £ y+(y*) such that Y < Y^. Since 
U is a decreasing function we have E[U(Y)] > E[U(Y^)], which implies that V(y) > V(y). 
Therefore 

V{y) < EpOG)] < E[U(Y)} = V{y) < V(y). 

That gives V(y) = V(y) = E[U(Y^)] = E[U(Y)] and (1) is proved. (3) can be proved in the 
same way as that of |16| . Lemma 5.8 and is omitted here. □ 

Remark 2.5 We know that Y < Y£ but we have not claimed that Y = Yj,. This would 
be the case if one chose a naive and seemly natural stochastic process Y t * = E[Y\J-t] for 
< t < T. However, it is not clear if X*Y* is a supermartingale with this construction. 

We now continue to use the control process nt instead of 6t which are related by ix\ = -V i . 
The domains of the prime and dual problems are given by © and © , respectively. Since the 
filtration is generated by diffusion processes the Doob-Mayer decomposition theorem implies 
that the positive supermartingale Y G y+(y) can be decomposed as: 

Y t = ye{-a'W) t D t 

where e is the Doleans-Dade exponential and dDt = —fyDtdt, fit > 0, and -Do = 1, i.e., Y 
satisfies the SDE 

dY t = Y t {-a' t dW t -/3 t dt). 

Proposition 2.6 Let K be the positive polar cone of K, i.e., K = {p : p'v > 0, Vv G K}. 
Then the optimal value of the dual problem can be characterized by 

V{y)= inf E[U(Y T )} 
Yey+(y) 

where y+(y) is the set of processes Y satisfyiny 

dY t = -Ytio-^vt + 9{t))'dW u Y = y 

and v are progressively measurable with v t G K a.s. for all t, and 9(t) = a(t)~ 1 b(t). 

Proof. Obviously, V(y) = \n{ Y&y+(y) E[U(Y T )}. When X G X + (x) and Y G y+{y), Ito's 
lemma implies 

dX t Y t = X t Y t (ir' t b(t) - ir' t o-(t)a t - /3 t )dt + X t Y t (ir' t o-(t) - a' t )dW t . 



Since XY is a supermartingale and nonnegative, we must have n' t b(t) — Tr' t a(t)at — jit < a.s. 
for all t. Define vt := — a(t)(9(t) — at). Then at = o~(t)~ l vt + 9{t). Supermartingale property 
of XY gives 

-n't v t < Pt, V7ri G K a.s. 

lit is the upper bound of — TTjUj for an tt* S X. Since X is a cone we must have Vt G i^. 
Otherwise, if on a positive measure set A G J 7 , u* is not in X. Then the support function 
C(vt) = sup pt <z K (—ir' t vt) = oo, which implies [3 t = oo on A, a contradiction. Define 

P := {D > 0, dA = -PtDtdt, Pt >0,D = 1} 

then Y = YD G 3> + (y), F G 3>+(y) and DeV. 

V(y) = inf Ml/fYr)] = inf E[U{Y T D T )\ < inf E[U{Y T )]. 

Yey+{y) Yey+(y),D£V Y&y+(y),D=l 

On the other hand, U is decreasing and D t < 1. Thus 

inf £R7(1t)1 > inf M[7(Y T )1- 

Soy(y) = inf y ^ +(2/)J E;[C/(y T )]. D 

Denote by V(t, y) the value function of the dual problem, i.e., 

V(t,y) = inf E[U(Y T )\Y t = y}. 
Yey+(y) 

Then the dual HJB equation is given by 

V t + inf d\0(t) + aity^WVyy} = 0, y > 0, t < T (7) 

with the terminal condition V(T, y) = U(y). It is easy to verify that V(t,y) is convex in y 
for fixed t G [0, T]. Denote by 7r(t) the unique minimizer of /(tt) = |#(i) + <T(t) _1 7r| 2 over 
■k G K and #(£) = #(£) + o"(t) _1 7r(t). The equation ([7]) is then equivalent to a linear PDE 

Vt + \W)?y 2 V yy = 0, y > 0, < t < T. (8) 

3 Smooth Solutions to HJB Equation 

We assume that U and 8 satisfy the following conditions. 

Assumption 3.1 Utility function U is a continuous, increasing, concave function on [0, oo) 
satisfying U(0) = 0, U(oo) = lim x _> 00 U(x) = oo, and 

0< U(x) <L(l + x p ), x>0 (9) 

for some constants L > 0, < p < 1. 

Assumption 3.2 8 is continuous on [0, T] and there is a positive constant 8q such that 
\8(t)\ > 9 for all t e [0,T]. 

Remark 3.3 Condition [/(0) = can be replaced by U(0) > -oo. If U G C^O, oo), then 
[/'(oo) = from Q. We do not assume that the Inada condition holds. If U satisfies 
Assumption 13.11 then U is a continuous decreasing convex function satisfying U(0) = oo, 
[/(oo) = 0, and 

< U(y) < sup{L(l + x p ) - yx} < L(l + y^), y > (10) 

where L = max{L, {Lp) Tzr p{p~ 1 — 1)}. In particular, if U G C , then [/'(oo) = 0. 



Consider the linear SDE 

dY s = -Y s §(s)'dW s , s > t (11) 

with the initial value Yf = y. Denote by Y s ' y the unique strong solution to (jlip and define a 
function V on [0, T] x (0, oo) by 

V(t,y) = E[U(Y^)}. 

Lemma 3.4 V satisfies 

0<V(t,y)<K(l + y^), t G [0,T] 

for some positive constant K. Furthermore, V is continuous on [0,T] x (0,oo) and is a 
viscosity solution to the linear PDE (0§|). 

p 
Proof. Define Z s = I Y s ,v I v for s > t. Ito's lemma implies that Z satisfies the SDE 

dz s = z s ( p _ \§( s )\ 2 ds - -^e(s)'dw^\ 

V 

with initial value Z-t = y p_1 ■ Therefore 

Z T = y^ exp ( — g i)2 jf |0( S )|W)lJ t 

where 

H t = e W N f\{s)'dW 8 -^j \v(s)\ 2 ds) 

and r}(s) = izz0(s). Since £(.#*) = E(H T ) = 1 we have from ([10]) that 



y(t, y) < l(i + e[z t ]) < k(i + y— ; 

2(p-l)^ io l 9 < 

yo > we have 



" p f T \§(s)\ 2 ds 

where K = Le 2(p_1)2 ° . Furthermore, for all < t < T and y > yo for any fixed 



2p „ 

— r T lA/^ia, 



E[(U(Y^ y )) 2 ] < K 2 E[{1 + y~H t ) 2 } < 2K 2 (l + yf 1 e^ \^ s ^ ds ) 

which implies that {U(Y T ' y ) : < t < T, y > yo} is a class of uniformly integrable random 
variables. From the continuity of U and Y^ with respect to t and y we conclude that V is 
continuous on [0, T] x (0, oo). Since V(t, y) = E[V(t, Y T ' y )] for any stopping time r > t it is 
straightforward to show that V is a viscosity solution to ([8]), see, for example, [12]. □ 

Next we show that V is smooth and strictly convex in y and is a classical solution to ([8]). 
Since E/ is only continuous and convex, we must improve the regularity and convexity. The 
regularity is well known in the PDE theory. The key idea to improve convexity is connected 
to the convexity preserving and constant rank principle for solutions of PDEs, see [T| [2| [HI [TT] . 
The techniques used here are likely to be useful in solving other problems involving nonlinear 
equations. 

Lemma 3.5 The function V is a classical solution to $8$. Furthermore, V G C 1,oo ([0,T) x 
(0, oo)) and satisfies 

V y (t,y)<0, V yy (t,y)>0 

for every t G [0, T). 



Proof. Define v(t, z) = V(t, e z ). Then v(t, z) < K(l + e? -1 ) and v is a continuous viscosity 
solution to the linear PDE 

vt + \\G{t)?{v zz -v z ) = 0, zeR,0<t<T 

with the terminal condition v(T,z) = U{e z ) for z G R. Let r = \ j t \d{rj)\ 2 d'q and v(t, z) = 
e4~zv(t, z). Then the equation for v is reduced to the standard Cauchy problem 

v T — v zz = 0, z G R, t > 

with the initial value v(0,z) = e~^U{e z ). It is easy to see that v is a classical solution and 
v G C oo ' oo ((0,oo) x R). Since v(t, z) grows exponentially in z, we obtain from the Poisson 
formula ([7], Chapter 1) that 



v (T,Z 



Hence 



1 f°° ( Z -Q 2 _5 - , 

—== / e 4t e 2jJ(e i )d^. 

A r J-oo 



1 - 1 - l ~ -'-^- -4fc-*)i 



v(t,z) = ^=e~4 T e ~ e^^We*)^ 

2Vvrr 



-oo 

and v G C^QO,! 1 ) x U). Finally we get 

V(t,y) = -!—e-^ I e-^^r^Cl/O^ ( 12 ) 

2 V 7rr JO 

and V" G C 1,oo ([0, T) x (0, oo)). Since C7 is decreasing and convex, it follows that V^ is 
decreasing and convex for fixed t G [0, T) from (I12p . Hence 

n(i,y)<0, F w (t,y)>0 

for every t G [0,T). Differentiating (jSJ) twice, we conclude that w(t,y) = V yy (t,y) is a 
nonnegative classical solution to the equation 

wt + ^\0{t)\ 2 y 2 w yy + 2\6(t)\ 2 yw y + |#(i)| 2 u; = 0, y > 0, < t < T. 

If w(to,yo) = for some (to)2/o) with t < r, then (io,2/o) i s a minimum point of w and 
V yy (t,y) = w(t,y) = for all (£, y) G (to,T) x (0, oo) by the strong maximum principle ([7], 
Chapter 2). This implies that V(t,y) is linear in y for any fixed t G (io,j"] ; in particular, 
U(y) is linear. This is a contradiction and we conclude that V yy (t, y) > for every £ G [0, T). 
Similarly, we deduce that V y (t,y) < for every t G [0, T). □ 



Lemma 3.6 We have 



and 



lim V(t, y) = oo, lim V(t, y) = (13) 

2/->0 1/-K30 



lim Vy(£, y) = — oo, lim V v (t, y) = 

?/— >0 j/— >oo 



/oriG [0,T). 

Proof. We have from (|12p and Remark 13.31 that 



2 [^~ ir l°- '"- «-•* 



1 - 1 ' -^ - 2 --Vm 



This implies that lim^o V(t,y) = oo. 

To prove lim^oo V(t, y) = 0, we can estimate, for y > 1 and a > 0, that 

f 1 (lnQ 2 3 ~ f a (lnQ 2 3 _P_ _P_ 

I e 4T £~*U(yf;)dZ, < L e *r £-2(1 + yp-ifp-i)df 
Jo Jo 



v 



< L / e — ^-^2(l + ( P -i)d( 
'0 



and 



f 00 (lnQ 2 3 - / f 00 (lnQ 2 3 \ ~ 

/ e — —T*U(yOd£<l e — ~ f^H tf( j/). 



Combining these estimates, we conclude that lim^oo V(t, y) = 0. 

Since V(t,y) is a convex smooth function in y for fixed t E [0, T), we conclude that 
Vy(t,y) is increasing in y. Suppose Hm^o^/C^y) = ^4 > — oo. Then t^(t,y) > A and 
VXM) - V'Ct, j/) > JyV y (t,x)dx > A(l - y) for < y < 1. This contradicts to (fT3|) . 

Similarly, we deduce that lim^oo V y (t, y) = for every £ G [0, T). □ 

Let Y(t, •) be the inverse function of — V y (t, •), i.e., 

-V y (t, Y(t, x)) = x, Y(t, -V y (t, y)) = y, 

for fixed t G [0,T). l"(t,x) is well defined on [0,T) x (0,oo) from Lemmas 13.51 and 13.61 Since 
V G C^QO,! 1 ) x (0,oo)) and V yy (t,y) > 0, the inverse function Y G C 1 ' 00 ^,! 1 ) x (0,oo)) 
by the implicit function theorem. Let 

u(t,x) = mi{V(t,y) + xy}. (14) 

y>0 

We now show that u is a classical solution to the HJB equation ([3]). We need the following 
result which is similar to |18j . Lemma 3.2. 



Lemma 3.7 Let a be a given number. Let n(t) be the unique minimizer of convex function 
/(#) = |sgn(a)0(i) + o-(t)- l v\ 2 = |a(t)- 1 (sgn(a)6(t) + ^)| 2 



over tt £ K, where sgn(a) is a sign function which equals 1 if a > and —1 if a < 0. Denote 

M 

2 



0(t) = sgn(a)0(t) + o-(t)- 1 7r(t). T/ien vr*(i) =-- ^L>/(vr(t)) = |a|(<7(*)') -1 0(*) «s the unique 
minimizer of convex function 



over tt G if. Furthermore, 



« 7 (vr) = i|7rV(t)| 2 -avr'6(t) 



5 (vr*(i)) = -^a 2 |0(i)| 2 . 



Proof. Since if is a convex cone, we see that f(rjit) attains its minimum at rj = 1. Hence 
Jr(t)'Df(7t(t)) = 0. Furthermore, for any given q £ K, f{rj^{t) + {l — rj)q) attains its minimum 
at T] = 1, which implies q'Df(ir{t)) > w(t)'Df(jt(t)) = 0, we conclude that Df(jt(t)) G if. 
Direct computation yields 

£>/(*(*)) = 2(a(t)a(t)')- 1 (sgn(a)6(t) +*(*)) = 2(a(i)')- 1 0(i) 

and 

Dg(ir) = a(t)a(t)'-K - ab(t). 



Let 7r*(t) = QDf(n(t)) = \a\(a(ty)~ x 9(t). Then vr*(t) G A' and simple algebra shows that 

(n*(t))'Dg(n*(t)) = 0, ir'Dg(n*(t)) > 
for all 7r € A, which implies that 7r*(i) is the unique minimizer of g over ir £ K. Furthermore, 

g(n*(t)) = \a 2 W)\ 2 ~ aH{t)> a^y^t) = -\a 2 \6{t)\\ 

u 
We now state the main result of this section. 

Theorem 3.8 Assume K is a closed convex cone and Assumptions VJ. I\ and UTM hold. Then 
there exists a function u G C°([0, T] x [0, oo)) n C 1,2 ([0,T) x (0, oo)) which is a classical 
solution to the HJB equation |3|). The maximum of the Hamiltonian H is achieved at 

l\—lnfj.\ u x\t,X) 



n*(t,x) = -(o-(t)T l e(t) 



•E'U'xxsJ'i % ) 



and 7T*(t,x) G K. Furthermore, u(t,x) is strictly increasing and strictly concave in x for 
fixed t G [0, T) with u(T,x) = U(x) and u(t,0) = 0, and < u(t,x) < K(l + x p ) for some 
constant K. 

Proof. Let u(t,x) be defined by (0. We have, for (t,x) G [0,T) x (0,oo), 

u(t, x) = V(t, Y(t, x)) + xY(t, x), 
which yields the regularity of u(t,x). Direct computation yields 

u t (t, x) = V t (t, Y(t, x)), u x (t, x) = Y(t, x), u xx (t, x) = 



Vyy(t,Y(t,x)) 



Since Y(t,x) > and V yy (t,Y(t,x)) < for fixed < t < T, the function u(t, •) is strictly 
increasing and strictly concave. Substituting y = Y(t,x) into equation (|8|) we get 



u t -\\6{t)\^ = V. 

We conclude by lemma 13.71 that u is a classical solution to the HJB equation ([3|) and the 
maximum of the Hamiltonian is achieved at Tr*(t,x). Furthermore, from Lemma 13.41 

u(t, x) < inf {K{1 + yi^i) + xy} < K(l + x p ) 
where K = K + ± (^Y' 1 . a 

4 Verification Theorem 

Theorem 13.81 confirms that there is a classical solution u to the HJB equation and the Hamil- 
tonian achieves its maximum at a point n* in K, i.e., there is a classical solution to the 
nonlinear PDE 

u t -\\6{t)\ 2 ^- = 0, x>0,t<T. 

We now show that the value function V is indeed a smooth classical solution to the HJB 
equation ([3]) with the optimal feedback control ir* . Since the drift and diffusion terms in 
SDE ([1]) do not satisfy the uniform Lipschitz continuous and linear growth conditions due 



to the unboundedness of the control set K , we do not know if solutions to SDE ([I]) are 
square integrable and cannot directly apply the method of localization and the dominated 
convergence theorem to prove the verification theorem, see [12] for details. We assume that 
the following additional condition be satisfied for admissible trading strategies tt: 



E 



eXP Q/ |7r * CT(t)|2dt ) 



rT 

< oo. (15) 



Condition (fT5j) is stronger than the usual square integrability condition E[J t \ir' t a(t)\ 2 dt] < 
oo. It can be shown that the set of all admissible controls it satisfying (|15p is a convex set. 
We can now state the verification theorem. 

Theorem 4.1 Let u be given as in Theorem \3.8\ and admissible controls satisfy U5\) . Then 
V(t,x) < u(t,x) on [0, T] x (0, oo). Furthermore, if it* satisfies U5\) and SDE ([I]) admits a 
unique nonnegative strong solution with the feedback control tt* . Then V(t,x) = u(t,x) on 
[0, T] x [0, oo) and tt* is an optimal Markovian control. 

Proof. Since u is a smooth classical solution to the HJB equation ([3]) we have for all (t, x) £ 

[0, T) x (0, oo) and vr £ K, that 

Ut(t,x) + u x (t,x)xTr'b(t) + -u xx (t,x)x |7rV(t)| <0 (16) 

and the equality holds in (fT6|) if it = n*(t, x). For any s G [t,T), stopping time r E [t, oo), 
and admissible control tt satisfying (I15p . we have, by Ito's lemma and (|16p . that 



u{s A t,X^ t ) < u(t,x) + f 8 T u x (v,X t v ' x )X t v ' x 7T , v a{v)dW v (17) 

where X s ' x is the solution of SDE ([T]) with the trading strategy tt and the initial condition 
X t ' x = x. Let 

t = t h = inf{s > t : I \u x (v,X^ x )X^ x TT' v a{v)\ 2 dv > n}, 

then the stopped process { f^ T u x (v, X v ,x )X v ,x Tr' v a(v)dW v ,t < s < T} is a martingale. Taking 
expectation in (fTTl) leads to 



E[u(sAT n ,Xl' x Tn )]<u(t,x). (18) 

Since < p < 1 we may choose a E (1, 1/p) and show, by Theorem 13.81 and the convexity of 
function x a , that 

u(sAr n ,Xl' x Tn r < {k{l + {Xlt Tn Y)T 

^ana-l/i i / v-t,x 



K a 2<*~ 1 [l + x a ?H: ATn exp( jf V v dv)) 



where 



Amt„ = ex P ( / (ap)7r(,cr(u)dW u - -(ap) 2 |<°'( u )| 2 ^ 
^ = (ap)TT' v b{v)--{ap)\TT' v a{v)\ 2 + -(ap) 2 \TT' v a(v)\ 2 . 



Simple algebra shows that 




*„ = 


~-j{ a P)( l ~ a P)\ a { v )' K. 


< 


ap \a( m2 
2(l-ap) l<?(w)| - 




Therefore, 






u(s A 


r ni X^ Tn r<K c 


<2 a-l | 



' aivyHiv)] 2 + — ap . |cr(^)~ 1 6(^)| 2 



1 — ap 2(1 — ap) 



1 + ^iJj ATn exp( jf 2(1^) I^WI 2 ^)) • 



Finally, since ir satisfies (fT5|) and < ap < 1 we know that HgAr n is a martingale from 
Novikov's condition, which implies 

E[u(s A TnX'^T] < K a 2 a ^ (l + s*«p(jT 2(1 "^ 1^)1^)) • 

We conclude that {u(s A r ra ,X s ^ Tn ) : n > 1} is a family of uniformly integrable random 
variables. Since r„ | oo a.s. as n — > oo and u S C°([0, T] x [0,oo) we may let n tend to 
infinity in (fT8|) to get 

i?Ka''i<«(i,x). 

We can apply exactly the same discussion as above and let s tend to T, also note the terminal 
condition, to get 

E[U{X^ X )} <u(t,x). 

From the arbitrariness of admissible control n we deduce that V(t, x) < u(t,x). 

Next denote by X s ' x the solution to SDE ([1]) with the trading strategy ir* . From Ito's 
lemma, (|16p with the equality, and the same discussion as above we have 

E[u(t,X t f)]=u(t,x). 

Letting s tend to T we get 

u(t, x) = E[U(X%")] < V(t, x). 

We have proved that V(t,x) = u(t,x) and the optimal feedback control is n*(t, x). □ 

5 Smoothness of Value Functions 

In this section we show that if the value function is continuous on the closure of its domain 
then it is in fact smooth. Admissible trading strategies ir are not assumed to satisfy (]15p and 
therefore the verification theorem 14.11 cannot be applied. 

Theorem 5.1 Assume that V is continuous on [0, T] x (0, oo). Then V = V. 

Proof. Since it E K is an admissible control for the dual problem, we have 

< V(t, y) < E[U(Y T )] < K{1 + y A), y > 0. 

We have < V(t,y),V(t,y) < K(l + y^). Let h(y) = y + y- m with m > ^-. Then 

h{y) > 0, h"{y) > 



for y > 0. Let 

V(t,y)-V(t,y) 
W{t > y) = ^%) 

where A is a constant to be determined later. Then w is continuous on [0, T] x (0, oo) and 

w(T, y) = 0, lim w{t, y) = 0, lim w(t, y) = 0. 
y— i>0 »/— s-oo 

Claim: iy(t,y) < for (t,y) G [0,T] x [0,oo). 

If not, then there is a point (io>2/o) £ [0,^0 x (0, oo) such that 

w := w(to,yo) = sup w(t,y)>0. 

[0,T)x(0,oo) 

Let 

0{t,y):=V(t,y)+w o e Xt h(y) 

be a test function which satisfies V(t,y) < 4>(t,y) and V(to,yo) = <j>(to,yo). Since V is a 
viscosity subsolution of ([7]) we have 

<p t + inf (^(tJ + ^-^lV^wj >0 (19) 

at (to,yo)- Substituting <j> into (fT9|) . also noting that (j) yy > and V is a solution of ((HI), we 
get 

w e xt (^\e(t)\ 2 y 2 h" + \h) >0 

at (to,Vo)- Substituting h(y) = y + y _m into the above inequality, we obtain 

A^ +1 + A+^(t)| 2 m(m + l)>0. 

This leads to a contradiction if we choose A < — ^9 2 m(m + 1) where 9\ = maxo<t<T \&(t)\. 
This proves that V(t,y) < V(t,y). Similarly, we can show that V(t,y) < V(t,y). □ 

Lemma 5.2 Let Assumption \3.1\ hold. Then the value function V(t,x) satisfies 

0<V(t,x) <L{l + x p ) 

for some constant L. 

Proof. Define a stochastic process for < t < T by 

i-t -i rt 



H t = exp (- f 6{s)dW s - i J \6(s)\ 2 ds\ . 



Assumption 13.21 and the Novikov condition imply that H is a positive martingale. Define 
an equivalent probability measure Q by ^p = Ht- Then the Girsanov theorem implies that 
W® = Wt+f Q 6(s)ds is a Q-Brownian motion and the wealth process X is a Q-supermartingale 
for < t < T. Therefore Eq[Xt] < x. Note also that 

g = H T := exp QT 6(s)dW a s -if \6(s)\ 2 ds^ 

Let p = \jp and q = 1/(1 — p), applying the Holder inequality, we get 



E[X T ] = E Q [X T —\ < {E Q [{X T Y]Y IP {E Q [(H T f}) < x*(E Q [H T }) 



Since 

F| = ex P n qO{s)dW Q s -i ^ g 2 |0(s)| 2 cM exp Q jf (f - g)|0(s)| 2 d S J 



and VF is Q-Brownian motion, we get 



£ Q [ilf ] = exp Q jfV - g)|0(s)| 2 ci S ) 



which results in 

(E [#|])^ = exp (^^y jT l*tol 2 <fa) • 

Putting everything together, we get from ([9]) that 

V(t, x) = sup E[U{X T )} <L[1+ sup E[X%] ) <L(1 + x p ) 
weA(t,x) y 7reA(t,x) y 

where L = Le^t^^ |e(s)|2ds . □ 

Lemma 5.3 Assume the value function V is continuous on [0, T] x [0,oo). Then V is a 
viscosity solution to the HJB equation: 

-V t {t,x) - H{t,x,V x {t,x),V xx (t,x)) =0 

with the terminal condition V(T,x) = U(x) and the boundary condition V(t, 0) = 0. 

Proof. Since K is a cone we know that the Hamiltonian H defined in (J3J is oo if M > and 
is either or oo if M = 0. Therefore, if H is positive at some point (t, x,p, M) we must have 
M < 0. Applying Lemma l3.7| we can write 

H(t,x,p,M) = x 2 Minf {*'Kt)^ + i|<T(t)'7r| 2 } = -^W)?- 

It is clear that H is continuous at any point where it is positive. The remaining proof that 
V is a viscosity supersolution and a subsolution is the same as that of [12], Prop. 4.3.1 and 
Prop. 4.3.2. The only difference is that we do not use the function G as in the proof of 
Prop. 4.3.2 for subsolution property. The function G ensures that H is continuous at any 
point where it is positive, which has been established directly. □ 

Remark 5.4 In fact, we only need to assume that the value function V is locally bounded 
on [0, T] x [0, oo) to get the viscosity property. We need to define its upper-semicontinuous 
envelope V* and lower-semicontinuous envelope V* on [0, T] x [0, oo) by 

V*(t,x)= limsup V(t',x'), V*(t,x)= liminf V(t',x') 

(t',x')->(t,x) {f ,x')^(t,x) 

and use V* (and V*) instead of V in the definition of viscosity subsolution (and supersolution) . 
Since V may be discontinuous at boundary of [0, T] x [0, oo) it is much subtle to define the 
proper terminal and boundary conditions, see [12} [T5] for details. This is the main reason 
we assume that V is continuous on [0, T] x [0, oo). In general, one needs to add some strong 
conditions to ensure the continuity of V on the closure of its domain, see [6]. 

We can now state the main result of this section. 



Theorem 5.5 Assume that the value function V is continuous on [0,T] x [0,oo). Then 
V = u and V is a classical solution to the HJB equation |3|). 

Proof. Let H = max{L, K}. Then < V(t, x),u(t, x) < H(l + x p ). Let h(x) = (x + l) q with 
p < q < 1. Then 

fc(x) > 0, /i'(a;) > 0, h"(x) < 

for x > 0. Define 

V(t, x) - u(t, x) 

e M h(x) 
where A is a constant to be determined later. Then w(t,x) G C([0, T] x [0,oo) and 

w(T,x) = 0, w(t,0)=0, Urn w{t,x) =0. 

x— >oo 

Claim: iu(t,x) < for all (t,x) G [0,T] x [0,oo). 

If not, then there is a point (to,xo) G (0, T) x (0,oo) such that 

wo := «j(to>#o) = SU P w(t,x) > 0. 

[0,T]x[0,oo) 

Let 

<p(t, x) = u(t, x) + wqc t h(x) 

be a test function which satisfies V(t,x) < 4>(t,x) and V(to,xo) = <p(to,xo). Since V is a 
viscosity subsolution of ([3|) we have 

4> t + sup { -\n'a{t)\ 2 x 2 <l) xx + ir'b(t)x$ x 1 > (20) 

at (to,xo). Substituting <f> into ([20]) . also noting that u is a solution of ([3]), we get 

w e xt (sup l~\w'a(t)\ 2 x 2 ti' + w%(t)xti\ + \h\ > 

at (to,xo). Applying Lemma [5771 we obtain 

Since /i(x) = (x + l) 9 , the above inequality becomes 

^(<o)| 2 ^^ + A(x„ + l)«>0. 

This leads to a contradiction if we choose A < — 2 (\- \ @i- This proves that V(t, x) < u(t,x). 
Similarly, we can show u(t,x) < V(t,x). □ 

6 Applications 

In this section we present two examples which can be solved with the main results of the 
paper. The first one is the efficient frontier of utility and CVaR and the second one is the 
preservation of monotonicity of the absolute risk aversion. 



6.1 Efficient Frontier of Utility and CVaR 

In the standard utility maximization theory the risk is not considered. However, in practice 
one often needs to find the optimal tradeoff between return and risk. This is the fundamental 
idea of the Markowitz's mean variance efficient frontier theory. In [19] the problem of the 
efficient frontier of utility and CVaR is discussed. A utility loss random variable Z is defined 
by Z = U(xq) — U{Xt), which represents the risk associated with a trading strategy ir in 
comparison with a riskfree strategy ir = 0. Two common risk measures are VaR and CVaR. 
Given a number /3 £ (0, 1) (close to 1) the /3-VaR of Z is defined by 

VaR,g = mm{z : P(Z < z) > /?} 

and the /3-CVaR of Z is defined by 

CVaR^ = mean of the /3-tail distribution of Z 

where the /3-tail distribution Fp(z) is defined by 

for z < VaR/j 




F/3 ^ 1 '" -'-' iovz>VaRf3. 

A fundamental minimization formula is established in |13j . Theorem 10, to compute VaR^ 
and CVaR^ by solving a convex minimization problem in which the minimum value is CVaR^ 
and the left end point of the minimum solution set gives VaR^. Specifically, 

CVaRs = min[y + 5E(Z - y) + ] 
y 

where 5 = (1 — /3) -1 . If y* is the left endpoint of the minimum solution set, then VaR^ = y*. 
The following optimization problem is discussed in J19I : 



sup(E[U(X T )] - ACVaR^) subject to ® 

TV 

where A is a nonnegative parameter. A = corresponds to the utility maximization while A — > 
oo to the CVaR minimization. The efficient frontier of utility and CVaR can be determined 
by first solving a parametric utility maximization problem 

u(x ,y) = supE[U v (X T )] subject to CD), (21) 

7T 

where 

U y {x) = U{x) - \5(U(x ) - U(x) - y)+ + \5(U(x ) - y)+, 

and then solving a scalar concave maximization problem 

u(x ) = sup(u(x ,y) - X8(U(x ) - y) + - Ay). (22) 

v 

There exists an optimal solution to the first stage problem (|2ip for every fixed y under 
some additional conditions on U (strictly increasing, strictly concave, C , and cV'(O) = oo), 
and there exists an opitmal solution to the second stage problem (122p as the objective function 
is concave, Lipschitz continuous, and tends to — oo as y tends to oo, see [19] for details. 

Note that if U satisfies Assumption 13.11 then so does U y for every fixed y. Therefore The- 
orems [331 and HTT] hold true for parametric utility maximization problem (|2ip . In particular, 
we can construct a smooth classical solution to HJB equation (J3]) with U being replaced by 
U y and show that the value function is equal to that smooth solution if admissible trading 
strategies satisfy the integr ability condition f)15|) for every fixed y. This opens the way to 
solve the first stage problem with the standard numerical method for nonlinear PDEs and to 
find the parametric optimal control and optimal value for problem (|2ip . 



6.2 Monotonicity of Absolute Risk Aversion Measure 

In this subsection we assume U £ C 2 . The Arrow-Pratt measure of absolute risk aversion for 
a utility function U is defined by 

m , U"(x) 

R(x) - 



U'(x) 

R is a constant for exponential utility functions and is a decreasing function for power and 
logarithmic utility functions. Since R{x) = — (lnU'(x))' it is clear that R is increasing 
(decreasing) if and only if ]nU'(x) is concave (convex). For the value function V(t,x) with 
V(T, x) = U(x) we may define a dynamic Arrow-Pratt measure of absolute risk version by 

R(t x ) = _Ye^2^1 

provided all derivatives are well defined. The monotonicity properties of optimal investment 
strategies is discussed in [3] which shows that that R(t, x) inherits the monotonicity of R{x) 
with the martingale approach. Here we give a new proof with the PDE approach and the 
duality method. We also extend the results of [3] as we do not need the Inada condition. The 
next result is needed in proving the monotonicity of R(t,x). 

Lemma 6.1 Suppose that U £ C 1 and yU'(y) — U{y) is convex (concave) in y. Then 
yV y (t,y) — V(t,y) is strictly convex (concave) in y for t <T. 

Proof. Let w(t,y) = yV y (t,y) — V(t,y). From (fl2j) . we get 

w(t, y) = ^^e-~S f°° e-^C § [(yt)U'(yt) - &&£)]<%. 

-V 7rr Jo 

This implies the convexity of w(t, y) in y for t < T. A simple computation yields the following 
equation 

wt + ^\0(t)\ 2 y 2 w yy = 0, y > 0, < t < T. 

As in Lemma [3.51 we deduce that if w yy (to,yo) = for some (io? 2/o) with to < T then 
U(y) = Ciylny + C2y + C3 with constants C\, C2, C3, which contradicts the assumption 13. 11 
Therefore w(t,y) is strictly convex in y for t <T. □ 

The next theorem shows that lnV x (t,x) preserves the convexity (concavity) of lnU'(x). 

Theorem 6.2 Let the assumptions of Theorem \3.8\ hold and let U G C 1 and U be strictly 
increasing and strictly concave. Then \nV x (t,x) is strictly convex (concave) for t < T if 
lnU'(x) is convex (concave). 

Proof. Assume lnU'(x) is concave. As in the proof of Lemma 4.1 in [3], we conclude that 
U'(e z ) is convex. Then yll'(y) — U(y) is convex. From Lemma 16.11 we see that yV y (t,y) — 
V(t,y) is strictly convex for t < T, i.e., (yV y (t,y) — V(t,y)) yy > for t < T. A direct 
computation implies 

(yV y (t,y)-V(t,V)) y y = (yVyy)y = y^yly - 

Since V is strictly concave in x for t E [0, T), we conclude that (lnV^) xx < and In ^.(£,2;) 
is strictly concave for t < T. □ 

Corollary 6.3 In addition to the assumptions of Theorem \6. 21 assume that U £ C 2 . Then 
R(t, •) inherits the monotonicity of R for t < T. Furthermore, R(t, •) is strictly increasing 
(decreasing) for t < T if R is increasing (decreasing). 
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